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1.  Introduction 

There  are  a  variety  of  point  processes  associated  with  the  jump 
times  of  a  Markov  process.  For  instance,  in  a  Markovian  network  of 
queues,  one  might  be  interested  in  the  point  process  of  times  at  which 
units  move  between  two  sectors  of  the  network.  More  generally,  if  the 
network  has  synchronous  movements  of  items,  one  might  be  interested  in 
the  marked  point  process  of  the  times  at  which  batches  of  units  move 
between  two  sectors  and  the  numbers  of  units  in  the  batches  (the  batch 
size  being  the  "mark"  of  the  time  of  the  movement).  One  can  formulate 
such  a  point  process  as  a  functional  of  the  Markov  process  representing 
the  network.  The  typical  aim  is  to  describe  the  behavior  of  the  point 
process  in  terms  of  the  characteristic  of  the  Markov  process.  Some 
immediate  questions  in  this  regard  are:  Is  such  a  point  process  Poisson 
(or  marked  Poisson)?  Is  a  collection  of  these  point  processes 
multi-variate  Poisson  (or  marked  Poisson);  and  wliat  are  the  dependencies, 
i f  any ,  among  them? 

These  are  the  issues  this  study  addresses.  We  begin  in  beet  ion  2  by 
presenting  conditions  under  which  a  point  process  of  certain  jump  times 
of  a  Markov  process  is  a  Poisson  process.  It  is  well  known  that  a  simple 
point  process  on  the  real  line  is  Poisson  with  rale  a  if  its  compensator 
has  the  constant  intensity  a  (Theorem  2.3(i)).  We  present  a  reverse-lime 
version  of  this  (Theorem  2.3(ii)).  It  says  that  if  the  Markov  process  is 
stationary  and  the  compensator  of  the  point  process  in  reverse  lime  lias 
the  constant  intensity  a,  then  the  point  process  is  Poisson  with  rate  a. 
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This  is  an  easy-to-use  criterion  for  establishing  whether  a  point  process 
of  jump  times  is  Poisson.  We  also  give  necessary  conditions  for  this 
Poissonness.  In  Section  3,  we  present  similar  conditions  under  which 
more  general  functionals  of  a  pure  jump  Markov  process  are  marked  Poisson 
processes.  Some  of  our  results  overlap  those  of  Melamed  (19Y9),  Bremaud 
(1981),  Variaya  and  Walrand  (1981).  and  Disney  and  Kiessler  (19S7). 
Melamed  and  Disney  and  Kiessler  derive  their  results  using  a  Markov 
renewal  argument  and  Bremaud,  Variaya  and  Walrand  use  a  filtering 
argument.  We  use  a  simpler  approach  based  on  the  notion  of  the  time 
reversibility  of  the  compensator  of  a  point  process.  This  approach  lays 
bare  the  cliaracteristics  underlying  the  Poisson  property,  and  it  readily 
extends  to  the  more  general  settings  in  Sections  3-5. 

The  applications  in  this  area  have  been  primarily  for  queueing 
systems  Burke  (1956)  and  Reich  (1957)  showed  that,  in  a  stationary 
M/M/1  queueing  system,  the  output  flow  is  a  Poisson  process  with  the  same 
rate  as  the  Poisson  input  flow.  Similarly,  the  exit  flows  from  the 
queues  in  a  Jackson  network  are  independent  Poisson  processes;  this  is 
discussed  in  the  references  in  the  preceding  paragraphs  ;uiti  m  Nelly 
(1979),  Disney  and  Konig  (1985)  and  Whittle  (1986).  In  Sections  2-4,  we 
discuss  applications  identifying  Poisson,  compound  Poisson  and 
mu  1 1 i var iate-Poisson  flows  in  single  queues  and  in  queueing  networks  with 
dependent  nodes.  We  end  in  Section  5  by  indicating  how  our  results 
extend  to  Markov  processes  with  general  stale  spaces  and  to  functionals 
of  semi -Markovian  processes. 
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2.  .Jump  Times  of  a  Markov  Process  that  Form  a  Poisson  Process 


Let  X  -  {X^:  t  £  R)  be  a  Markov  process  with  a  countable  state  space 


9  and  transition  rates 


q(x.y)  =  lim  P{X  =  y  |  X  =  x)/t  ,  x  jt  y, 

t  lo 


and  q(x.x)  =  0.  We  indicate  later  how  our  results  extend  to  a  general 


state  space.  We  adopt  the  standard  assumption  that 


q(x):=  2  q(x,y)  <  «° ,  x  €  9 , 

y 


and  that  each  sample  path  of  X  is  right  continuous  and  has  a  finite 


number  of  jumps  in  any  finite  time  period.  Then  the  sojourn  time  of  X  in 


a  state  x  is  exponential  with  mean  q(x)  and.  at  the  end  of  the  sojourn, 


X  jumps  to  some  state  y  with  probability  q(x,y)/q(x),  y£:l .  For 


convenience,  we  assume  that  X  is  irreducible. 


We  shall  study  the  point  process  N  on  R  defined  by 


(2.1) 


N(A)  =  >:  f (X  ,X  ) 

t£A 


where  A  is  a  Uorel  set  in  R  and  f:  9  x  )  — ♦  {0.1}  with  f(x,x)  =0,  x  £  9. 


The  IN(A)  is  the  number  of  jumps  of  X  from  some  x  to  some  y  for  which 


f(x.y)  =  1  in  the  lime  period  A.  Any  such  f  is  an  indicator  ion 


' ( x , y )  =  l((x,y)  £  S)  of  a  subset  S  of  :t  x  9  that  does  not  contain  pairs 


of  identical  values;  the  N(A)  would  then  be  the  number  of  transitions  of 


X  in  the  period  A  that  take  place  in  the  transition  set  S.  Clearly  N(A) 


is  finite  when  A  is  bounded  and  it  may  be  infinite  when  A  is  unbounded. 


We  shall  frequently  use  the  function 


(2.2) 


a(x)  =  >:  q(x,y)f(x,y).  x  £  :1 . 

y 


First  note  tliat  'the  mean  measure  of  N  is 


which  is  Levy ’ s  formula  (see  for  instance  Benvcniste  and  Jacod  (1973)). 
Wlien  X  is  stationary,  ;in  easy  check  shows  that  N  is  stationary  (i.e.  for 


any  Aj . A  .  the  distribution  of  N(A^+t) .  N(Af+t)  is  independent  of 

t).  Consequently,  EN(s,t]  =  a(t-s),  s  <  t  in  R,  where 
(2.1)  a  =  EN(0,  1]  =  X  7r(x)q(x,y)f(x,y) 


x.y 

and  tr(x)  =  P(Xt=x)  is  the  equilibrium  (or  stationary)  distribution  of  X. 

Here  0  <  a  <  Also,  with  probabi  1  i  ty  one,  l  *N(  s,  s+ 1  ]  -»  a  as  t  -*  00 

One  can  use  N  to  model  a  variety  of  event  occurrences  of  X  by 

appropriate  selections  of  f.  For  instance,  suppose  X  takes  values  in 

1  -  Zm.  the  m-dimensional  vectors  with  nonnegative  integer -valued 

entries.  Then  N  records  the  downward  jumps  of  X  when  f(x.y)  =  1  iff 

x  ?  y  and  x.  >  y.,  j=l . m.  Similarly,  N  records  the  jumps  of  X  at 

J  J 

which  the  maximum  component  does  not  change  when  l'(x.y)  =  1  il  l  x  ^  y  and 

max  x  .  =  max  y  . . 

1  1 
j  J  .1  J 


We  shall  investigate  conditions  under  which  N  is  a  Poisson  process. 
We  say  that  the  future  of  N  is  independent  of  the  ixist  of  X.  denoted 
N+  -U-  X_  ,  if  (N(A):  AC  [  t  . 00 ) }  is  independent  of  (X^:  u  <  t),  t  €  R. 
({X^:  u  <  t)  catt  be  replaced  simply  by  X^  since  X  is  Markov i;tn). 
Similarly,  N_  X+  denotes  that  the  past  of  N  is  independent  of  the 
future  of  X.  Our  first  result  is  that  these  conditions  are  sufficient 
for  N  to  be  a  Poisson  process;  the  N  might  be  a  non-stat ionary  Poisson 
process.  We  write  "N  is  't(a)"  to  me;m  that  N  is  a  stationary 


(time-homogeneous)  Poisson  process  with  rate  a.  The  degenerate  case  a  = 


We  now  discuss  conditions  on  t  ho  parameters  of  the  Markov  process  X 
tinder  which  N  is  :l'{ a).  When  X  is  stationary  with  equilibrium 
distribution  rr .  we  shail  frequently  use  the  function 

(2.5)  a*  (x)  =  tr(  x )  1  X  tr(y  )q(y  ,x)f  (y  ,x),  x  C  :i . 

y 

Theorem  2.T.  (i)  If  «(x )  =  a,  x  C  1 ,  t  hen  N  X_  and  N  is  t(a).  (  i  i  ) 

If  X  is  stationary  with  equilibrium  distribution  rr,  ;uid  a  (x)  =  a.  x  £  1 . 
then  N_  X+  and  N  is  “/'(a). 

Proof .  Assertion  (i)  is  a  special  case  of  Theorem  18.9  in  Liptser  and 
Shiryayev  (1978)  (or  Theorem  T5  in  Bremaud  (1981)),  which  says  that  a 
simple  point  process  on  R  is  "^(a)  if  its  compensator  has  the  non-random 
intensity  a.  In  our  setting,  for  each  s  C  R,  the  process 

(2.6)  Mt  =  N(s,s  +  t]  -  /“+l  a(X(|)du 

is  an  5^-mar tingale,  where  =  afX^:  s  <  u  <  s  +  t);  the  process 
A^  =  /^+t  a(Xu)du  is  the  compensator  of  N(s,  s  +  t]  and  cr(X(  )  is  the 
intensity  of  this  compensator. 

K  — 

To  prove  assertion  (ii).  consider  the  process  X^  =  X  ,  t  C  R,  where 

—  M 

=  X^_.  The  X  is  the  right-cont  inuous  t  i me- reversal  of  X.  Each 

* 

sample  path  ol  X  is  the  same  as  a  s:imple  path  of*  X  traversed  in  the 
opposite  direction,  and  vice  versa.  Since  X  is  stationary,  it  follows 
that  X  is  an  irreducible,  stationary  Markov  process  and  its  transition 
rates  are 

*  ~  1 

q  (x.y)  =  ?r(x)  ir(y)q(y.x).  x.y  €  * . 

Define  the  point  process  N  on  R  by 

N*(A)  =  >:  f*(X*  .  X*) 

tCA 

where  f*(x,y)  =  f(y.x).  x.y  C  1.  Clearly  N*(A)  =  N(-A),  for  each  A,  and 
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so  N  is  the  time-reversal  of  N.  Consequently,  N  is  T(a)  if  and  only  if 

t 

N*  is  ^(a) . 

Now  observe  that  «  (x)  =  2  q  (x,y)f  (x.y).  Iliat  is,  a  is  the 

y 

function  a  for  the  processes  X  ,  N  .  Then  an  application  of  (i)  to  X  ,N 
says  that  N+  X_  and  N  is  :f(a)  .  But  these  statements  are  eqivalent  to 
the  respective  statements  that  N_  X+  and  N  is  '/“(a),  since  X  ,  N  are 
the  time  reversals  of  X.N.O 

Remarks.  (1)  In  Theorem  2.3,  statement  (i)  is  the  well-known 
property  of  Markov  processes  iliat  N  is  i’J'(a)  if  the  intensity  a  ( X  ^ )  of  N's 
compensator  equals  the  constant  a.  Statement  (ii)  is  simply  a  reversed 
time  version  of  {i)t  it  is  (i)  in  terms  of  X  and  N  viewtxl  in  reverse 

-K-  M 

time.  [he  a  is  the  reversed  lime  version  of  a  in  the  sense  tliat  a  ( X ^ ) 
is  the  intensity  of  the  compensator  of  N  in  reverse  time.  Also.  N_  X+ 
in  (ii)  is  the  time  reversal  of  N+  ^  X_  in  (i).  (2)  Note  that  the 
process  X  in  (i)  may  be  transient,  recurrent  or  non-slat  ionary ;  but  in 
(ii),  X  must  be  stationary.  (3)  In  consulting  the  references  for 
Theorem  2.3(i),  one  can  see  that  this  result  is  true  for  a  non-Markovian 
process  X  for  which  a:  ij.  -»  is  a  function  such  iliat  the  process  Mf  in 
(2.6)  is  an  “^-martingale.  Similarly,  it  follows  that  Theorem  2 . 3 ( i i )  is 
true  for  a  non-Markovian  process  X  if  a  :  :f  -*  R+  is  a  funci ion  such  that. 


for  each  seR, 


M*  =  N[s-t,s)  -  /S  a*(X  )du 
t  L  ’  7  s  —  t  '  ir 


is  an  “?  -martingale  where  3  -  a(X  ■  s-t  <  u  <  s). 

l  t  v  u 
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In  applications,  the  Poisson  property  of  N  due  to  «(x)  -  a,  x  €  it. 


is  usually  foreseen,  while  the  Poisson  property  of  N  due  to  a  (x)  =  a,  x 


€  4,  might  not  be  anticipated.  Here  is  an  example. 


Example  2.4.  M/M/1  and  Batch  Service  Queues.  Suppose  the  Markov  process 


X  lias  the  state  space  Z+  and  transition  rates 


q(n.n  +  1)  =  ,\  n  C  7. 


q(n,n  -  K)  =  p  n  >  K 


q(n ,0)  =  p  n<K 


where  A,  p  and  K  are  positive.  This  process  represents  the  number  of 


customers  in  a  queueing  system  in  which  customers  arrive  singly  at  the 


rate  A  and  are  served  in  batches  such  that  when  n  >  K  customers  are  in 


the  system,  then  batches  of  K  customers  depart  at  the  rale  p;  and  when 


n  <  K  customers  are  present,  then  all  of  the  customers  depart  at  the  rate 


p.  When  K  =  1,  this  is  the  M/M/1  queueing  system. 


Implicit  in  the  description  of  this  queueing  system,  the  point 


process  N  of  customer  arrivals  is  "/‘(A).  regardless  of  whether  X  is 


transient  or  recurrent.  Indeed,  this  follows  from  Theorem  2.3  (i)  since 


N  is  defined  by  (2.1)  with  f(n.n')  =  1  iff  n’  =  n  +  1  ;ind 


a(n)  =  2  q ( n , n  * ) f ( n , n ’ )  =  q(n,n  +  1)  =  A. 


Now,  suppose  that  N  denotes  the  point  process  of  limes  at  which 


batches  of  size  K  depart  from  the  system.  This  is  defined  by  (2.1)  with 


f(n.n')  =  1  iff  n'  =  n  -  K  and  n  >  K.  In  this  case. 


«(n)  =  q(n,n  -  K)l(n  >  K)  =  pl(n  >  K) . 


This  depends  on  n,  and  so  Theorem  2.3  (i)  does  not  ensure  that  N  is 


Poisson.  However,  assume  that  X  is  stationary.  Necessarily,  A  <  |iK  and 


the  equilibrium  distribution  of  X  is 


9 


V 

V 


ir(n)  =  r(l-r).  n  >  O  . 


where  r  €  (0,1)  is  the  unique  root  of 

K+l 


ftr 


(A  +  p )  r  +  X  -  0 


(see  Section  3.2  of  Gross  and  Harris  (1983)).  Clearly 

_  l 

a  (ri)  =  tr(n)  X  ir(  n '  )q (n  '  .  n)  f  ( n  '  ,  n  ) 
n ' 

=  tr(  n)  *  ?r(  n  +  K)q(n  +  K.n) 

=  pr^  =  p  +  A ( 1  -  I/r ) . 

Titus,  we  conclude  by  Theorem  2.3  ( i  i )  that  the  process  N  is 

(i  +  A(  1  -  1/r)).  One  would  probably  not  anticipate  this  result  from 
the  description  of  the  process,  or  even  from  earlier  work  in  this  area. 
For  the  special  case  in  which  X  is  the  M/M/1  queue,  we  have  K  -  1. 
r  =  A/p,  and  so  N.  which  is  the  departure  process,  is  /’( A).  Burke  (195G) 
;md  Reich  (1957)  were  the  first  ones  to  prove  this. 

Fjcample  2.5.  Queues  With  Compound  Poisson  Arrivals  and  Poisson 
Departures.  Suppose  the  Markov  process  has  the  state  space  Z  and 
transi tion  rates 


q(n,  n  +  m)  =  A^  p™  '(1  -  p) 
q(n,  n  -  1)  =  p 


m  >  1  , 


n  >  1 


n  C  Z 


where  A  ,  p  are  positive  and  0  <  p  <  1.  This  process  represents  the 
n  n 

number  of  customers  in  a  queueing  system  in  which  batches  of  customers 

arrive  at  the  rate  A  when  n  customers  are  present  and  the  number  of 

n 

customers  in  a  batch  has  a  geometric  distribution  with  par  time ter  p.  The 
customers  depart  at  the  rate  p  when  n  are  in  the  system.  The 


equilibrium  distribution  of  X  is 


tr(n)  =  tr( 0) A^tj  1  ..  .p(j*  17  (Aj.  +  ppk), 

1 


n-1 


ii  >  l  , 


provided  the  sum  of  these  terms  over  n  is  Finite,  which  we  assume  is  true 
(see  Kook  (19SS)). 

Suppose  that  N  is  the  point  process  of  customer  departures.  This  is 

defined  by  (2.1)  with  f(n.n')  =  1  iff  n'  =  n  -  1.  Clearly, 

«*(0)  =  W( 0)_1B-(  i)<|(  1.0)  =  A() 

*  - 1 

«  (n)  =  tr(n)  n( n  +  l)q(n  +  l  ,n)  =  A  +  PMr.  n  >  1. 

Thus,  if  X  is  statiorutry  and  A,,  =  a  ;uid  A  +  pu  =  a.  n  >  1,  then  the 

()  n  it 

departure  process  N  is  ^(a). 

We  end  this  section  with  elaborat ions  on  Theorem  2.3  that  establish 
necessary  conditions  for  N  to  be  Poisson. 

Theorem  2.6.  When  X  is  recurrent,  the  following  statements  are 
equi valent  . 

( i )  N+  -N-  X_  and  N  i  s  ./“( a) . 

( i i )  a(x)  =  a,  x  €  3 . 

( i  i  i )  N  +  -W-  X_  and  EN(s,t]  =  a(  t -s) ,  s  <  t  in  R. 

(iv)  K[a(X()  |  X  =  x]  =  a,  x  €  T,  s  <  t  in  R. 

Proof .  Theorem  2.3  ensures  that  (ii)  implies  (i).  Clearly  (i)  implies 

(iii).  Now,  if  (iii)  holds,  then,  for  s  <  t  in  R, 

a(t-s)  =  l-:N(s,t]  =  E[N(s.t]  |  X  =  x] 

=  /l  L[a(X  )  I  X  =x]du 

the  last  equality  being  Levy’s  formula.  Taking  the  derivative  of  this 
with  respect  to  t  yields  (iv).  Finally,  if  equation  (iv)  holds,  then 
taking  the  derivative  of  it  with  respect  to  t  and  letting  t  1  s,  we 


This  says  that  a  is  a  liarmonic  function  of  t  tie  Markov  matrix 

{q(x -y  )/q(x) }  •  Now,  this  matrix  is  recurrent  under  t  tie  assumption  ttiat  X 

is  recurrent.  But  we  know  (see  for  instance  Section  7.2  of  Cinlar 

(1975))  that  harmonic  functions  of  irreducible,  recurrent  Markov  chains 

are  constant  This  observation  and  equation  (iv)  imply  (ii).O 

Theorem  2.7.  When  X  is  stationary  with  equilibrium  distribution  n .  the 

following  statements  are  equivalent. 

(i)  N_  -U-  X+  and  N  is  “/•(a)  . 

(ii)  a* ( x )  =  a ,  x  €  it. 

(iii)  N_  X+  and  EN(0.  1]  =  a. 

(iv)  E[a*(X^)  |  X  =  x]  =  a,  x  t  1,  s  <  t  in  R. 

(v)  a*(x)  =  2  a( y)tr(y)  =  a.  x  C  a. 

y 

Proof .  The  equivalence  of  (i)  -  (iv)  follows  from  Theorem  2.(i  applied  to 

* 

the  reversed-t ime  processes  N  ,  X  defined  in  the  proof  of  Theorem  2.3. 

Furthermore,  (v)  obviously  implies  (ii).  And  (ii)  implies  (v)  since  N  is 

&( a)  by  (i)  and  by  (2.4),  we  have 

a  =  EN(0,  1]  =  !lQ  Ea(Xt)dt  =  2  «(y)tr(y). 

y 

Thus  (i)  -  (v)  are  equivalent  statements. □ 

Remark  2.8.  Statement  (v),  relating  a  to  a,  is  the  "independence 
condition"  that  is  the  focus  of  Melamed  (1979),  Bremaud  (1981)  and 
Varaiya  mid  Walrand  (1981).  Their  main  result,  which  is  implicit  in 
Theorem  2.7,  is  as  follows:  If  X  is  stationary  with  equilibrium 
distribution  rr .  then  N_  -U-  X+  if  and  only  if  a  (x)  =  2  n(y)tt(y),  x  C  it . 

y 

In  this  case,  N  is  :t( a)  where  a  is  the  preceding  sum. 
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Although  we  are  considering  processes  N  and  X  defined  on  the  entire 
real  line,  our  results  herein  also  apply  to  such  processes  defined  on  any 
time  interval  I  in  R.  Indeed,  consider  the  process  extended  to  all  of  R 
and  then  the  results  apply  to  these  extended  processes  and  hence  to  their 
restrictions  to  I. 

3.  General  Poisson  Functionals  of  Markov  Processes 


r  t 

V  J 


We  have  been  studying  the  point  process  N  tliat  records  the  times  at 

which  the  Markov  process  X  jumps  from  some  x  to  some  y  with  f(x.y)  =  1. 

We  shall  now  study  a  more  general  point  process  that  records  additional 

information  at  these  jumps.  Suppose  that  h  is  a  function  from  i  x  J  to 

some  space  if '  .  Consider  the  marked  point  process  M  on  R  x  it '  defined  by 

(3.1)  M(AxB)  =  X  f (X  .X  )l(h(X  X  )  G  B) 

tCA 


V 


where  f  is  as  above.  A  x  B  is  in  the  a-f  ield  of  R  x  and  1(*  €  B)  is 
the  indicator  function  of  B.  I'his  M  is  a  functional  of  X  that  records 
the  "mark"  h(Xt_,X^)  at  each  jump  time  l  of  X  at  which  f(X  ,X  )  =1.  As 
a  point  process,  M  is  simple  and  M({l)  x  it '  )  =  0  or  1 ,  t  €  R.  Also, 

M(A  x  it'  )  =  N(A)  records  the  times  at  which  M  records  the  marks. 

In  this  section,  we  identify  conditions  on  X  under  which  M  is 
Poisson  with  EM((s.t]  x  B)  =  a(t-s)F(B),  where  a  >  0  and  F  is  a 
probability  measure  on  it'.  In  this  case,  the  process  N  of  occurrence 
times  of  the  marks  of  M,  is  tf*(a).  and  each  mark  has  the  distribution  F. 

We  call  such  an  M  a  marked  Poisson  process  with  rate  a  and  mark 
distribution  F,  and  we  simply  say  M  is  Jd'(a.F). 


The  approach  we  used  in  Section  2  for  deriving  Poisson  characteri¬ 
zations  of  N  readily  extends  to  yield  marked  Poisson  characterizations  of 
M.  Hie  following  result,  are  analogues  of  Theorems  2.1,  2.3  and  2.7;  the 
analogue  of  llieorem  2.6  can  be  seen  from  Theorem  .3.3  and  hence  is  not 
displayed.  Their  proofs  are  omitted  since  they  follow  the  same  line  of 
reasoning  as  their  counterparts  in  Section  2.  Here  we  let 
a(x.B)  =  2  q(x.y)f(x.y)l{h(x,y)  C  B) 

y 

a* ( x . B )  =  tr(x)  1  2  tr(y  )q(y  . x)  f  (y  ,x )  1  (h(y  ,x)  €  B) . 

y 

Theorem  3.1.  If  M  ^  X_  or  L  ^  X  .  then  M  is  a  Poisson  process.  In 
+  + 

this  case,  M  is  JW(a.F)  if  and  only  if  Ea(X  ,B)  =  aF(B),  for  each  t  and 
B. 

Theorem  3.2.  (i)  If  a(x,B)  =  uF(B),  for  each  x  and  B,  then  M+  X_  and 

M  is  JW(a,F).  (ii)  If  a  (x.B)  =  aF(B),  for  each  x  and  B,  then  M_ X+ 
and  M  is  F)  . 

Theorem  3.3.  Wlien  X  is  stationary  with  equilibrium  distribution  w.  then 
the  following  statements  are  equivalent. 

(i)  M_  -U-  X+  and  M  is  MP( a.F). 

(ii)  a  (x.B)  =  aF(B),  for  each  x  and  B. 

(iii)  M_ X+  and  EM((0,1]  x  B)  =  aF(B)  for  each  x  ;u»d  B. 

(iv)  E[a  (X^.B)  |  X(=x]  =  al'(B).  for  each  x,  B  and  s  <  t  in  R. 

(v)  a  (x.B)  =  2  u(y,B)ir(y)  =  al'(B),  for  each  x  and  B. 

y 

Point  processes  of  the  form  (3.1)  are  useful  for  representing 
mu  1 1 i var ia le  and  compound  point  processes.  Indeed,  suppose  one  is 
interested  in  the  n-dimensionul  compound  point  process  (Mj . M^) 
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5S 

6s 


K 


(3-2) 


M  (A)  =  S  f(Xt_.Xt)h  (Xt_.X() 


t£A 


where  Ik  :  S  x  1  -»  R  (or  any  other  group).  These  processes  contain  the 


same  information  as  M  defined  in  (3.1)  with  ft '  =  R  and 


h(x.y)  =  (hj(x,y) . h  (x.y)).  More  precisely,  there  is  a  one-to-one 


correspondence  between  point  processes  M  on  R  x  R  as  in  (3.1)  and 


n-dimensional  compound  point  processes  (M^ . M  )  as  in  (3.2).  Note 


that  M  on  R  x  Rn  is  JtI“(a,F)  if  and  only  if  its  corresponding  (M^ . M  ) 

is  an  n-dimensional  compound  Poisson  process  wilh  rate  a  and  atom 


distribution  F  on  R  .  In  this  case. 


P{M  (s , t]  €  B, . M  (s. t]  €  B  } 

*  1 '  -1  1  n  J  n' 


=  2  Fk*(B,x...xB 

k=0  1 


.  k,  k  -a( t-s)  , 

)a  ( t  — s  )  e  Vk!  . 


And  each  M ^  is  a  compound  Poisson  process  with  rale  a^.  =  a(l-F.(0))  and 


atom  distribution  F.,  where  F. . F  are  the  marginal  distributions  of 

jin 


F.  Here  are  some  special  cases: 


Cl:  . Mn  are  independent  compound  Poisson  processes  with  rates 


t. . a  and  atom  distributions  F . F  if  and  only  if  F  =  F.x...xF 

In  1  n  J  1  n 


C2:  (M. . M  )  is  an  n-dimensional  Poisson  process  with  rate  a  and 

v  1  n' 


point  allocation  distribution  F  on  {0,1}  if  and  only  if  F  has  support  on 


{0,1}  .  In  this  case,  each  M.  is  "/’(a.). 

J  J 


C3:  Mj . are  independent  Poisson  processes  with  rates  a^ . a^  if 

and  only  if  F  has  support  on  {e.,...e  },  where  e.  is  the  jth  unit  vector 

In'  j 

wilh  1  in  entry  j  and  0’s  elsewhere. 

Remark  3.4.  Each  of  the  preceding  theorems  hold  for  these  cases  Cl,  C2, 
C3  when  the  F  in  the  theorem  is  as  specified  in  the  case  of  interest. 


For  instance.  Theorem  3.2(ii)  for  case  C3  reads:  If  a  (x,{e^})  =  a  ^ , 
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j=  1 . m,  and  a  (x.  {z}  )  =  0  o therwi  se  ,  x  C  '3  ,  t  hen  (M  . . M  X  and 

v  1  n  + 

M  . Mn  are  independent  Poisson  processes  with  respective  rates 

1  n 

An  obvious  application  of  Theorem  3.2(i)  shows  that  the  process  of 
customer  arrivals  in  Example  2.5,  when  A  =  A,  is  a  compound  Poisson 
process  with  rate  A  and  geometric  atom  distribution  pm  *(l-p).  The 
following  is  an  example  of  a  not  so  obvious  compound  Poisson  flow  in  a 
queueing  process. 

Example  3.5.  A  Batch-Service  Queueing  System  With  Poisson  Arrivals  and 
Confound  Poisson  Departures.  Suppose  the  Markov  process  ltas  the  state 
space  Z+  and  transition  rates 

q(0.1)  =  A( 1  -  p),  q(n,n  +  1)  =  A,  n  >  1, 

q( n, n  -  m)  =  ppm  ^(1  -  p)  1  <  m  <  n.  n  >  1, 

q(n,0)  =  ppn  *  n  >  1  , 

where  A.ji  are  positive  and  0  <  p  <  1.  This  process  represents  the  number 
of  customers  in  a  queueing  system  in  which  customers  arrive  at  the  rate  A 
and  are  served  in  hatches  as  follows.  When  there  are  customers  in  the 
system,  "buses"  arrive  at  a  rate  p  to  take  them  immediately  from  the 
queue.  Busing  is  a  common  practice  in  computer  systems  and  material 
Itandling  systems.  The  number  of  customers  each  bus  can  take  is  a  random 
variable  with  the  geometric  distribution  p^^l-p),  m  >  1.  Also,  when 
there  are  no  customers  in  the  queue  and  a  customer  arrives,  then  with 
probability  p  there  is  a  bus  available  to  take  (he  customer  without 
delay.  The  equilibrium  distribution  of  X  is 
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Consider  the  compound  point  process 

D(A )  =  X  max{0,  X  -  X  J 
t€A  1  1 

that  describes  the  total  number  of  departures  in  the  time  period  A.  It 
records  the  times  at  which  batches  of  customers  depart  and  the  batch 
sizes  as  well.  This  process  corresponds  to  M  in  (3.1)  with  f(n.n')  =  1 
iff  n '  /  n  and 

h(n,n‘ )  = 

Clearly,  for  each  n  >  0  and  m  >  1, 

a  (n,{m})  =  n(n)  *  1  rr(n '  )q( n '  , n ) f  (n '  ,  n)  1  (h( n '  , n )  =  m) 

n’ 

=  ir(n)  *rr(n  +  m)q(n  +  m,n) 

=  X( 1  -  p)F({m>). 

where  F({m})  =  r™  *(l-r).  m  >  1,  and  r  =  pX/(/j+pX).  Thus,  if  X  is 
stationary,  then  Theorem  3.2(ii)  implies  that  M  is  MV(\( 1  -  p),F).  Hence 
D  is  a  compound  process  wi  tit  rale  X(  1  -  p)  and  geometric  atom 
distribution  F. 


n  -  n  '  n '  <  n 
0  n '  >  n 


4.  Poisson  Flows  in  a  Network  of  Queues 

We  shall  consider  a  queueing  network  process  defined  as  follows. 
Suppose  that  X(t)  =  (Xj(t) . X^t)),  t  C  R.  is  a  queueing  network 


process  on  m  nodes,  where  X^(t)  denotes  the  number  of  units  (i.e. 

customers)  at  node  j  at  time  t.  The  process  X  lakes  on  values 

n  =  (n  . n  )  in  7.  .  Let  e.  denote  the  jth  unit  vector  in  /m  with  1  in 

1  m  +  j  + 

entry  j  and  0’s  elsewhere.  As  in  Whittle  (1086),  we  assume  that  units 
move  among  the  m  nodes  such  that  X  is  a  Markov  process  with  transition 
rates 
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(1.1) 


q(n,n  +  e^)  =  X 


Ok 

q(n,n  -  e.  +■  e,  )  =  A..<f>( n  -  e.)/0(n),  n.  >  1, 
v  J  k'  ,]k  j'  '  .) 


q(n.n  -  c.)  =  A  _o0(  n  -  e^  )/4>(  n)  . 


n  .  >  1  . 
J  " 


and  q(n.n')  -  0  for  all  other  slates  n '  .  Here  't>-  Z™  -»  (O,1"),  the  A's  are 

nonnegative,  and  the  subscript  0  denotes  the  "outside"  node.  Under  this 

assumption,  units  enter  the  nodes  1 . m  by  independent  Poisson 

processes  with  respective  rates  A,. . A,.  .  When  X  is  in  stale  n,  then 

0 1  Om 

S  A.,  <t>(  n-e  .  )/4>(n)  is  the  departure  rale  of  units  from  node  j.  The  A.. 

k  jk  v  y  V  Jk 

is  the  "arc-dependent”  routing  intensity  from  node  j  to  node  k.  and 

0(  n-e  .)/<!>(  n)  is  the  "system-dependent"  departure  intensity  from  node  j 

(the  ratio  representing  the  potent ial  difference  between  the  system  in 

state  n  and  in  slate  n-e  .  with  one  less  customer  at  node  j). 

J 

We  shall  assume  that  X  is  irreducible.  This  is  equivalent  to  the 

i rreducibi 1 i ty  of  the  Markov  routing  matrix 

m 


(4.2) 


P(J.k)  =  A  /  >]  A 

J  e=o  ■' 


, k  -  0. 


.  m , 


where  A^  =  0.  The  i rreducibi 1 i ty  of  this  matrix  is  equivalent  to  the 

existence  of  unique  positive  numbers  w  ,...,w  tliat  satisfy 

1  in 


(4.4) 


>]  (w.A..  -  w.  A.  .)  -  0,  j  -  0 . m. 

'  1  iL'  L'  L'  i  '  •  ’ 


k=<) 


j  .jk  k  k.j 


m  n  . 

where  w,.  =  1.  We  also  assume  that  >'  $(n)  IT  w  ^  is  finite.  Then  X  is 
0  .  ,  .1 

n  ,]  =  1 

positive  recurrent  arid  has  the  equilibrium  distribution  (p.IDS  of  Whittle 

(  11)86) ) 


m  n 


(4.4) 


ir(n)  -  <:4>(n)  T7  w  .  ,  n  i 


j  =  l 


.1 


where  c  is  the  normalizing  const. uit  .  Hereafter,  we  assume  tliat  X  is 
stat ionary . 


AM 

1 

*v 


Now.  consider  the  point  process 

N  (A)  =  >:  1  ( X(  i )  =  X(t-)  -  e  ) 

J  1 1 A  J 

that  represents  the  times  at  which  units  exit  the  network  from  node  j. 

Oi'  course.  N  ...  =  0  when  A.,.  =  0. 

JO  jO 

Theorem  4.1.  The  exit  processes  N... . N  are  independent  Poisson 

lu  mU 

processes  with  rates  w  ,  A  ... . w  A  ...  and  ( N  ........  N  X  . 

1  10  m  mO  v  10  mO  -  + 

Whittle  (1980)  on  p.  207  proved  this  by  establishing  that  the 

* 

reverse  time  process  X  of  X  is  again  a  queueing  network  process  and  the 

exit  processes  of  X  are  'ust  the  time  reversals  of  the  Poisson  input 

processes  of  X  .  Theorem  4.1  also  follows  from  Theorem  3.2(ii)  and 

Remark  0.4  since,  for  each  n  and  j . 

*  —  ] 

a  (n,{e.))  =  ir(n)  tr( n  +  e.)q(n  +  e.,n)  =  w  .A  ._ 

J  J  J  .1  j0 

and  a  (n.jz})  =  0  elsewhere. 

Along  with  these  exit  processes,  consider  the  point  processes 

N  (A)  =  2  l(X(t)  =  X(t-)  -  e  +  e  ) 

JK  tt  A  J  K 

of  times  at  which  units  move  from  node  j  to  node  k.  We  shall  now 

identify  sets  J  C  (1 . m)  and  K  C  (0,1 . m}  such  that  N  jtj,  keK 

.1  k 

are  independent  Poisson  processes.  Suppose  that  J  and  K  satisfy  the 
following  assumptions' 

A1 :  Each  unit  that  exits  ,(  can  never  return  to  J.  (To  verify  this  one 
need  only  check  the  possible  routing  under  A  ^.) 

A2:  The  system-dependent  <le|x\rture  intensity  for  each  node  ,jt  I  is  of  th 


^(n  -  e.)/0(n)  =  ^  j  ( n  j  -  o  .  )/<*»  j(i*  ^  ) 


where  n.  -  (n.  :  jt.I).  ;tnd  <f> .  is  a  positive  function  on  such  vectors. 


v  * .» v 


V 


4  i  v,  >  i  r,  r  v 


rV 


v;v> 'v;v,v. 


1() 


r 

1 


a 


'V 

3 


fl 

I 


a 


fl 


I 


S3 


<3 


A3:  K  is  the  largest  subset  of  (0,1 . m}  such  tltat  each  unit  in  K 


cannot  enter  .1  on  a  subsequent  move.  (Note  that  0  0  K  and 


J  n  K  =  (j  C  J:  A  -  0.  P  C  .)} 


For  some  networks,  ,]  =  (1 . m)  may  be  the  only  set  of  nodes  that 


satisfies  A1 .  At  the  other  extreme  are  networks  in  which  each  node  is 


visited  at  most  once  by  a  unit,  and  so  each  subset  of  nodes  satisfies  A1 . 


Assumption  A2  is  equivalent  to  being  able  to  factor  'l*  as 


<J>(n)  =  <J>j(n  j  )^(n^  :  ktf.I).  Upon  selecting  ,J  conforming  to  A1  ,  A2,  it  is 


advantageous  to  select  K  as  large  as  possible  as  we  did  in  A3. 


Let  X  .(  t  )  =  {X  .(  t  )  :  j<  .1}  ,  ttR.  denot  e  the  process  X  on  the  nodes  J 
J  J 


and  let  J  denote  its  stale  space. 


Theorem  T.2.  I"he  processes  N.  j<J.  kcK,  are  independent  Poisson 

J  s 


processes  with  respective  rates  w  .A  .  jt.l.  ktk.  Furthermore. 


<N)k;jtJ.  kcK}_  JL  (Xj)+. 


1'roof .  Under  the  assumptions,  the  Xj  is  a  queueing  network  process  on 


the  nodes  J  with  transition  rates  q.(n.n')  defined  as  in  (1.1)  with  the 


last  line  replaced  by 


q.(n.n  -  e  )  =  A.<J>,  (n  -  e. )/<!>( n) 
J  J  .)  .1  ,)  ,lv  ' 


n  .  >  1  ,  iu  .1  . , 

.1  ~  J 


where  A  .  =  X  A  .  Furthermore,  X.  hits  the  equilibrium  distribution 

.1  k(K  ,)k  J 


n  .(n)  =  c  <f>  (n)  JJ  a. ,  nt.l 

j  j  JtJ  ,i  j 


This  is  .just  the  sum  of  tr(n)  in  (-1.-1)  over  all  n^,.  Pi,).  Thus,  I'rttm 


Theorem  1.1,  we  know  that  X's  exit  processes  N.  =  1  N.,  ,  jt,|.  are 

J  J  kcK  -,k  ‘ 


independent  Poisson  processes  with  respective  rates  w^A.,  jf.l.  and  that 


(Nj.  (Xj)+- 


2i 


* 


rv 

¥ 

& 


m 


0 


Next,  observe  tliat  for  each  j  t  J,  the  processes  N  k  t  K,  form  a 

J  K 

partition  of  N.  in  which  each  point  of  N.  is  assigned  to  the  subprocess 
J  J 

N...  with  probability  X../A.,  independent  of  everything  else.  Conse- 

J K  .) k  J 

c|uently,  N  ktK.  are  independent  Poisson  processes  with  respective 

rates  (X../A.)  (w.A.)  =  w.X..  .  ktK  (see  for  inscutce  p.S9  of  Cinlar 

(1975)).  ITiis  property  and  the  preceding  argument  yield  the  assertions.D 

Fxample  4.3.  Suppose  the  network  lias  a  node  j  such  that  each  unit 

passing  through  the  network  visits  j  at  most  once.  Also,  assume  that 

^(n)  =  4>  .( n .  )*^(n,  :  k  ?  j ) .  and  let  J  =  (j).  Then  the  depart  ure  processes 
J  J  k 

N....N.. . N.  are  independent  Poisson  processes  as  in  Theorem  4.2. 

JO  jl  jm  ^  K 

Now.  suppose  that  each  node  of  the  network  can  be  visited  at  most  once  by 

each  unit  and  <J>(n)  =  <t>.  (n.  ) .  .  ,<P  (n  ).  1'hen  each  process  N  ..  i  s  fl't  w  X  .  ) ; 

1  1  m'  m'  jk  j  ,]k' 

some  of  these  processes  may  be  dependent .  Consider  the  arrival  processes 
to  a  fixed  node  k.  let  J  denote  the  set  of  all  nodes  j  that  can  never  be 
reached  from  k.  Then,  under  the  preceding  supposition,  the  arrival 
processes  N  jej,  are  independent  Poisson  processes  as  in  Tlieorc;..  1.2. 

Kxample  4.4.  Multivariate  Poisson  Flows.  Suppose  J,. ....  !  are  subsets 

1  ■) 

of  (1 . m)  and  . are  subsets  of  (0,1 . m)  (the  subsets  need 

not  be  disjoint).  Consider  the  process  N.  =  2  N  of  times  at  which 

1  w,  Jk 

ktK. 

i 

units  move  from  some  node  in  J.  to  some  node  in  K. .  Suppose  the  sets 

l  l 

J  =  JjU.  .  ,UJ(j  and  K  =  K^U.  .  ,U<  satisfy  assumptions  A1  ,  A2 .  A3,  or  lliat 

they  are  contained  in  a  pair  of  such  sets.  1'hen  N  jt.J,  kfK.  are 

Jk 

independent  Poisson  processes  as  in  Theorem  4.2.  Consequently. 

(N . N  )  is  a  u-d imensional  Poisson  process  with  rate  a  =  X  w.X..  and 

1  "  .j  J  Jk 


kiK 


point  allocation  distribution 


where  I  C  (1 . t>  V ,  and  the  sum  is  over  all  j  in  (1  .1 .  ,  and  k  in  H  K.. 

it  1  it  I 

Hie  N, . N  are  independent  if  fl  J.  =  <J>  and  II  k.  =  <P  ■ 

1  i>  .l.i 

l  i 

Kxample  4.5.  Networks  With  Several  Types  of  Units.  Consider  a  network  as 

above  in  which  each  unit  carries  a  label  from  a  finite  set  :4  of  types  and 

the  label  may  change  when  the  unit  moves.  We  represent  this  network  by 

the  process  X( t )  =  {X  .(t):  at; A,  j  =  l . m).  ttR.  where  X  ,(t)  is  the 

•i  J  ti  j 

number  of  type  a  units  at  node  j  at  time  t.  A  typical  state  of  X  is 

n  =  ('Vjj'  atal,  j=l . m) .  We  assume  tliat  X  is  a  Markov  process  with 

transition  rates  (analogous  to  (4.1)) 

c,(n.n  *  ebk)  =  XQ^ 

q(n.n  -  ea.  +  e^)  =  *(..  -  eaj)/*(n).  n,  .  >  1. 

q(n ,  n  -  e  . )  =  X  .  _  <J>(n  -  e  .  )/<J>(n),  n  .  >  1. 

aj  aj,0  v  aj'  v  ’  aj  ” 

Under  assumptions  as  above,  the  process  X  lias  the  equilibrium 

d  i  s  t  r i bu  t i on 

n  . 

tr(n)  =  c4>(n)  fl  w  . 

a.j  JJ 

Ilie  results  above  hold  for  this  network  -  one  need  only  use  double 

indices  aj .  bk  in  place  of  j,k  and  consider  the  point  processes 

N  .  .  .  .  a j  l  J .  bk  e  K ,  where  J,  K  satisfy  assumptions  Al,  A2.  A3  with 
a.j.bk 

double  indices.  For  instance,  suppose  A  C  :4  is  such  tlial  a  unit  with  a 
label  from  :4\A  can  never  carry  a  label  from  A.  Consider  the  point 
processes  of  times  at  which  units  change  labels  from  A  to  AA.  These 


processes  are  N  bk ,  ajC.)  ,  bkCK.  where  ,1  =  (aj:  tit  A ,  j=l,  .  .  ,.m)  and 
K  =  (bk:  bC.vfVA .  k=0 . m)  .  Clearly  ,1  satisfies  Al  and  K  satisfies  A3. 


Suppose  J  also  satisfies  A2.  Then  the  preceding  point  processes  are 


independent  Poisson  processes  with  respective  rates  {w  .A  ...  1,  and  the 

aj  aj.bk' 


past  of  these  processes  is  independent  of  (Xj)+. 


The  preceding  results  are  for  networks  in  which  only  one  unit  can 


move  at  a  time.  In  networks  with  simultaneous  movement  of  units,  the 


flows  among  the  nodes  may  be  compound  Poisson  processes.  Kook  (1988)  lias 


characterized  such  flows  using  Theorem  3.2. 


5.  Further  Generalizations 


The  results  in  Sections  2  and  3  readily  extend  to  more  general 


processes.  We  discussed  some  of  these  situations  in  the  remarks  above. 


Here  are  some  more  generalizations. 


Markov  Processes  With  General  State  Spaces.  Suppose  tliat  X  =  (X^  ttR)  is 


a  pure  jump  Markov  process  with  a  general  state  space  F.  and  associated 


CT-field  S,  and  its  transition  kernel  is  K(x,B).  xtE.  Br  £ .  Tliat  is,  the 


exponential  sojourn  time  in  state  x  has  parameter  K(x,K)  and  the 


probability  of  X  jumping  from  x  into  B  is  K(x, B)/K(x . E) .  Then  the 


results  in  Sections  2  and  3  hold  with  the  sums  replaced  by  integrals. 


For  example,  a  is  the  Radon-N ikodym  derivative 


u  (x)  -  /  tr(dy)K(y  ,dx)f  (y  ,x)/ir(dx) . 

E 


Functionals  Involving  Sojourn  Times.  Suppose  X  is  a  Markov  process  as  in 


Sect  ion  2  and 


N(A)  =  >:  f(X  X  W) 
it  A 


where  W(  is  the  waiting  time  in  slate  X  and  f:f  x  t  x  R+  -*  (0,1).  Then 


the  results  of  Section  2  hold  for  this  N  with  ti,  a  defined  by 


V  Y,«r.V  H’JCtV  YJ)-  yjpjy  V  T  ,|,  n- — j-jy  y  -  ■ 
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a(x)  =  V  J()  q(x.y)f(x,y.w)Kx(dw) 

y 

x  -  1  ,00 

a  (x)  =  ir(x)  J0  X  tr(y)q(y.x)f(y.x,w)F  (dw) 

y  y 

where  F^(w)  =  1  -  exp(-wq(x)).  Similarly,  ihe  results  of  Section  3  hold 

for  M  as  a  functional  of  W  as  well  as  of  X  ,X  One  can  generalize 

t  t  t  -  - 

further  by  assuming  that  X  is  a  semi-Markov  process  tuid  replacing  by  a 
general  sojourn  time  distribution  F 
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